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This listing of claims will replace all prior versions and listings of claims in the 
application: 

Listing of Claims : 

1. (Currently Amended) A method for video analysis and content extraction, comprising: 
scene analysis processing of at least one video input stream; 
object detection and tracking for each scene, and; 
split and merge behavior analysis for event understanding; 

wherein the object detection and tracking step further comprises at least one of 
identifying a split behavior and identifying a merge behavior ; 

wherein the split behavior identification applies the formula: 



2. (Original) The method as claimed in claim 1, further comprising: 
storing behavior analysis results. 

3. (Original) The method as claimed in claim 2, wherein the behavior analysis results are 
stored in a database. 

4. (Original) The method as claimed in claim 2, wherein the behavior analysis results are 
stored in at least one video output stream. 



5. (Original) The method as claimed in claim 1, wherein the scene analysis processing 
further includes: 
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6. (Original) The method as claimed in claim 1, wherein the scene analysis processing 
further includes: 

camera calibration. 

7. (Original) The method as claimed in claim 1, wherein the scene analysis processing 
further includes: 

scene geometry estimation. 

8. (Canceled). 

9. (Currently Amended) The method as claimed in claim S claim 1 , wherein the split 
behavior includes an object splitting into two or more objects. 

10. (Canceled). 

11. (Currently Amended) The method as claimed in claim lO claim 1 , wherein the merge 
behavior includes two or more objects merging into a single object. 

12. (Original) The method as claimed in claim 1, wherein the object detection and tracking 
step further comprises identifying zero or more split behaviors and zero or more merge 
behaviors. 

13. (Original) The method as claimed in claim 12, wherein the split behaviors and merge 
behaviors are combined to model complex behaviors. 

14. (Original) The method as claimed in claim 13, wherein the complex behaviors include 
package drop off, package exchange, crowd formation, crowd dispersal, people entering 
vehicles, and people exiting vehicles. 
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15. (Original) The method as claimed in claim 1, wherein the behavior analysis step further 
comprises generating a directed graph including zero or more split behavior states and zero or 
more merge behavior states. 

16. (Original) The method as claimed in claim 15, wherein the behavior analysis step further 
comprises generating a hidden Markov model including the directed graph. 

17. (Original) The method as claimed in claim 4, wherein the results are stored as metadata. 

18. (Canceled). 

19. (Currently Amended) The method as claimed in claim 1 P el aim 1 , wherein the merge 
behavior identification applies the formula: 

m( At 1 * 1 >« r.m( \JAj^ ).. 

20. (Original) The method as claimed in claim 13, wherein the complex behaviors are 
categorized as one of simple, compound, and chain behaviors. 

21. (Currently Amended) An apparatus for video content analysis comprising: 
a processor for receiving and transmitting data; and 

a memory coupled to the processor, the memory having stored therein instructions 
causing the processor to perform scene analysis processing of at least one video input stream, 
detect and track objects for each scene, and analyze split and merge behaviors for event 
understanding; 

wherein the instructions causing the processor to detect and track objects for each scene 
further comprises identifying zero or more split behaviors and zero or more merge behaviors; 
and 
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wherein the instructions causing the processor to identify zero or more split behaviors 



includes the formula: 



22. (Original) The apparatus as claimed in claim 21, wherein the memory further comprises 
instructions causing the processor to store analysis results in at least one video output stream. 

23. (Original) The apparatus as claimed in claim 22, wherein the memory further comprises 
instructions causing the processor to store the results as metadata. 

24. (Original) The apparatus as claimed in claim 21, wherein the memory further comprises 
instructions causing the processor to perform at least one of scene change detection, camera 
calibration, and scene geometry estimation. 

25. (Canceled). 

26. (Currently Amended) The apparatus as claimed in claim 25 claim 21 , wherein the 
instructions causing the processor to identify zero or more split behaviors and zero or more 
merge behaviors further comprises combining the split and merge behaviors to model complex 
behaviors. 

27. (Original) The apparatus as claimed in claim 21, wherein the instructions causing the 
processor to analyze split and merge behaviors further comprises generating a directed graph 
including zero or more split behavior states and zero or more merge behavior states. 
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28. (Original) The apparatus as claimed in claim 27, wherein the instructions causing the 
processor to analyze split and merge behaviors further comprises generating a hidden Markov 
model including the directed graph. 

29. (Canceled). 

30. (Currently Amended) The apparatus as claimed in claim 25 claim 21 , wherein the 
instructions causing the processor to identify zero or more merge behaviors includes the formula: 

m( At h>l )*■ r.'mCA-t** 1 IfJ/^ ) 

31. (New) A method for video analysis and content extraction, comprising: 
scene analysis processing of at least one video input stream; 

object detecting and tracking for each scene; and 
analyzing split and merge behavior; 

wherein analyzing split and merge behavior includes generating a hidden Markov model 
(HMM), the HMM including a directed graph that includes at least one split behavior state or a 
merge behavior state; 

wherein generating the HMM includes generating a two-level HHM; 

wherein the first level HHM includes seven states, and the second level includes a 
plurality of sub-HMMs, the sub-HMMs being stand alone HMMs; and 

wherein the sub-HMMs are defined for people, person, and package split or merge 
interaction. 
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